Papers with one-to-one correspondence between modalities

1 papers
Incorporating Visual Semantics into Sentence Representations within a Grounded Space (D19-1)

Copied to clipboard

Challenge: Language grounding is an active field aiming at enriching textual representations with visual information.
Approach: They propose to transfer visual information to textual representations by learning an intermediate representation space: the grounded space.
Outcome: The proposed model outperforms the previous state-of-the-art on classification and semantic relatedness tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations